Environmental Sound Synthesis, Processing, and Retrieval
نویسنده
چکیده
It aims at targeting the multifaceted area of research devoted to the complex relation between environment and sound, a relation that still needs to be investigated. Indeed, we are literally immersed into sound: as Handel says, " Listening puts me in the world " ([1], xi). In this sense, a phenomenology of listening, delving deeply into the philosophical and psychological aspects of sound perception is mandatory in order to clearly understand the specific features of " auditory events " with respect to other perceptual modalities. With a classic example, while vision is in some sense always external to our body (emphasizing the separation between subject and object in perception), sound on the contrary resonates through our body, literally embodying the information that it carries on as we vibrate through the world we are surrounded/placed into. That is, " Listening is centripetal; it pulls you into the world. Looking is centrifugal, it separates you from the world " ([1], xi). Even if embracing a technologically oriented perspective, these philosophical and psychological aspects are not to be omitted while researching on environmental sounds. Through a historical tendency which origins date back to 20 years ago, sound is becoming more and more relevant in our media environment. As an example, one can think about sound systems in cinema, now a standard and pervasive solution on the market. Another example is new complex, multimodal, integrated displays now pervasively built into portable devices. Not by chance, the first edition of ICAD, the International Conference on Auditory Displays dates back to 1992, and from 2000 it is held on an annual basis. But, in order to effectively exploit sound, we have to avoid the risk to simply borrow principles and models from vision and to adapt them to listening, without a real understanding of specific perceptual features of the audible domain. Indeed, this applies to sound in general, but is particularly relevant for sound materials that have not been extensively studied by cultural practices with a long tradition, as it typically happens with music and speech. So, what is environmental sound? In some sense, sound is necessarily environmental as it is strictly coupled with its physical medium (including the listener). I have already anticipated a definition ex negativo that better specifies our field of interest: environmental sound is neither music nor language. Indeed, such a definition is at the same time too strict and too broad, …
منابع مشابه
Feature-Based Synthesis: Mapping Acoustic and Perceptual Features onto Synthesis Parameters
Substantial progress has been made recently in finding acoustic features that describe perceptually relevant aspects of sound. This paper presents a general framework for synthesizing audio manifesting arbitrary sets of quantifiable acoustic features of the sort used in music information retrieval and other sound analysis applications. The methods described have broad applications to the synthe...
متن کاملA Framework for Sonification of Vicon Motion Capture Data
This paper describes experiments on sonifying data obtained using the VICON motion capture system. The main goal is to build the necessary infrastructure in order to be able to map motion parameters of the human body to sound. For sonification the following three software frameworks were used: Marsyas, traditionally used for music information retrieval with audio analysis and synthesis, CHUCK, ...
متن کاملAn Ontological Framework for Retrieving Environmental Sounds Using Semantics and Acoustic Content
Organizing a database of user-contributed environmental sound recordings allows sound files to be linked not only by the semantic tags and labels applied to them, but also to other sounds with similar acoustic characteristics. Of paramount importance in navigating these databases are the problems of retrieving similar sounds using textor sound-based queries, and automatically annotating unlabel...
متن کاملDiscrimination and Retrieval of Environmental Sounds
The human auditory sense may be regarded as the second most important sense after the sense of sight. This valuation is reflected in the field of information retrieval where until recently research concentrated on visual information retrieval. Even research in audio retrieval (AR) focused on one single aspect of hearing, namely understanding of speech. With the upcoming of large music databases...
متن کاملEcological Acoustics Perspective for Content-Based Retrieval of Environmental Sounds
In this paper we present a method to search for environmental sounds in large unstructured databases of user-submitted audio, using a general sound events taxonomy from ecological acoustics. We discuss the use of Support Vector Machines to classify sound recordings according to the taxonomy and describe two use cases for the obtained classificationmodels: a content-based web search interface fo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- EURASIP J. Audio, Speech and Music Processing
دوره 2010 شماره
صفحات -
تاریخ انتشار 2010